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(57) Abstract . 

A network communication device for directing 
data units over a communication network includes at 
least one input and/or output port arranged to receive 
and/or transmit data units, a plurality of buffer units 
divided into several sub-pools, and a buffer allocator 
for allocating buffer units between the sub-pools. The 
buffer allocator is arranged to determine a priority value 
for each sub-pool based on quality of service for each 
connection established at at least one port. The buffer 
allocator is also arranged to determine a utilization value 
of the port, and arranged to allocate buffer units for 
each sub-pool based on the priority value and based 
on the utilization value. The buffer allocator creates 
a precedence list to ensure that a minimal number of 
connections which are established at a most utilized 
port, will suffer, data unit loss while receiving the data 
units. 
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5 ALLOCATING BUFFERS FOR DATA TRANSMISSION 

IN A NETWORK COMMUNICATION DEVICE 
Field of Invention 

The present invention relates to allocating buffers for data transmission in a 
network communication device constructed to direct network traffic. More particularly, 
10 the invention relates to allocating buffers in the network device based on port utilization 
and quality of service goals to achieve fair buffer usage. 

Background 

Computer networks have been used by a large number of users to increase 
computing power, share resources and communicate. Computer networks include a 

1 5 number of computers or other devices located in one room or one building and connected 
by a local area network (LAN), such as Ethernet or Token Ring. LANs located in 
different locations can be interconnected by switches, routers, bridges, microwave links 
or satellite links to form a wide area network (WAN). Such a network may include 
hundreds of connected devices distributed over numerous geographical locations and 

20 belonging to different organizations. 

One computer or video communication device can send data to another device 
using network communications devices (e.g., packet switches, routers, bridges) 
interconnected by transmission media or data links. Viewed from the outside, a network 
communications device includes input ports that receive data and output ports that send 

25 data over data links. Inside the network device, transmitted data is accepted at input 

ports, buffered and transferred internally, and eventually received at output ports for re- 
transmission over the next data link. This process uses various scheduling and 
arbitration algorithms for "switching" the data. 

Typically, network communications devices transmit data in a standardized 

30 format, such as TCP/IP datagrams, frames, or ATM cells, which generally will be 
referred to as data units. Each data unit typically includes a header portion with 
addressing information and a body portion with transmitted data or pay load. A data unit 
sent between network devices may, in general, vary in size depending on the type of the 
data unit. When a data unit arrives at an input port of a network communication device, 

35 a routing algorithm analyzes the header and makes a forwarding decision based on a 
destination address carried by the header. 

In the process of forwarding data from an input port to an output ports, different 
internal switching devices can use several temporary memories (called buffers). A 
communication device decides if an incoming data unit is buffered or dropped, based on 
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5 the incoming data unit itself. This decision is performed at the line speed, and is 

executed after the start of the header and before the last bit of the data unit is received. 
This way the communication device can re-use the current buffer for the next data unit if 
decided that the current data unit will be dropped. 

The buffers may simply be arranged into a single large pool of buffer units to be 

1 0 used for all received data units stored by the device. This arrangement assures that no 
data units will be arbitrarily dropped as long as there are available buffer units for 
storage. However, this arrangement cannot effectively arbitrate access to several 
concurrent inputs and outputs. Alternatively, separate pools of buffers may be associated 
with input ports and output ports. Based on the location of buffers, there are generally 

1 5 three classes of data switching architectures: output buffered, input buffered, or 

combined input-output buffered architectures. The present invention is applicable to all 
three architectures. 

An output buffered network device places data units, arriving at its input port, 
into different output buffers located at its output ports depending on the address of each 

20 data unit. An output buffered network device, having N input ports and receiving data at 
M bits per second, needs a data transmission rate of N x M for the switbhing to ensure 
that data units are not lost (i.e., dropped). The buffers store the received data units when 
the transmission rate is lower. 

Advantageously, output buffered network communication devices can use up to 

25 the full bandwidth of outbound data links because of the immediate forwarding of the 
received data units into output buffers. The data units are fed from output buffers to the 
output data links as fast as the links can accept them. However, when the transmission 
rate is lower than the reception rate, the communication device has to keep buffering the 
data units and may eventually run out of buffers. For a larger communication device 

30 having many input ports with a high link speed, the buffer capacity and speed must be 
increased proportionally in order to handle the combined data rates of all input ports 
being switched to different output ports. Increasing the buffer capacity and speed 
increases the cost of output buffered network devices. 

A network communication device can assign one pool of buffers for each output 

35 port (or input port), which is commonly called "per port queuing". In this arrangement, 
one port cannot interfere with another port's performance. However, higher priority 
traffic may suffer a higher loss of data units (e.g., ATM cell, frames) then lower priority 
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5 traffic. The data loss occurs even though there may be, for example, idle ports with 
available cell/frame buffers; this is the result of the buffer fragmentation. 

Alternatively, the communication device can assign one pool of buffers for each 
priority, which is called "per priority queuing". In this arrangement, higher priority 
traffic will not suffer data unit loss because of over-subscription of lower priority traffic. 

10 However, the buffers allocated to higher priority traffic may not be available to lower 
priority traffic when the higher priority traffic is idle. In another arrangement, the 
communication device can assign one pool of buffers for each priority for each output 
port (or input port). This is called "per port and priority queuing". Advantageously, a 
given port and priority will only drop data units due to the action of data streams using 

1 5 that port and priority. However, this arrangement fragments buffer queues and thus 
buffers may be used inefficiently. For example, buffer units may be assigned to ports 
and priorities that are currently idle, and thus buffer units are left unused. Therefore, 
efficient buffer allocation becomes very important. 

A network communication device can also use an input buffered architecture. 

20 Popular input buffered devices use non-blocking input buffered switching called the 
crossbar. The input buffered crossbar has a crossbar fabric running at a speedup of 1 
(i.e., equal to link rate). However, if each input port maintains a single FIFO queue, data 
suffer from head-of-line blocking. This blocking limits the maximum achievable 
throughput and is relatively inflexible. To eliminate head-of-line blocking, input ports 

25 can have virtual output queues (VOQs). Inputs ports with VOQs have a bank of queues 
with one queue per output port. Data units are stored in random access buffers at the 
input ports, and pointers to the data are stored in the respective VOQs. Buffer allocation 
becomes again important. 

Asynchronous transfer mode (ATM) switching technology enables fast data 

30 switching for wide ranges of traffic demands. ATM can carry virtually any type of 

information that can be expressed in a digital form, ranging from voice telephone traffic, 
to real-time video, to high-speed file transfers, etc. ATM based networks may eliminate 
the need for different networks to carry different types of traffic. ATM transfer is 
asynchronous in the sense that the recurrence of ATM cells, which carry transferred 

35 information, is not necessarily periodic. Each communication device that uses the ATM 
network submits an ATM cell for transfer when it has a cell to send. Once aggregated 
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5 and scheduled, the ATM cells ride in synchronous slots on a high-speed media, such as a 
SONET optical fiber. ~ 

ATM organizes digital data into cells having a fixed length and format. Each 
ATM cell includes a header, primarily for identifying cells relating to the same virtual 
connection, and the transmitted data or payload. The ATM standard defines a cell size 
1 0 that is 53 bytes or octets. The first five bytes of each ATM cell form the header, and the 
remaining 48 bytes represent payload data. The header of each ATM cell includes a 
field for a virtual path identifier (VPI) and a virtual circuit identifier (VCI). The VPI and 
VCI together identify the particular circuit or a communication path to which each cell 
relates. 

1 5 Within a transport stream, the VPI and VCI identifiers direct the stream into 

separate logical or 'virtual' paths and segregate traffic within each virtual path into 
logical or 'virtual' circuits. Within one or more virtual path connections, an ATM 
communication device makes the virtual circuit connections available to transport any 
number of individual communications. Such logical circuit connections are set up (i.e., 
20 opened) and closed, as needed, to efficiently provide a required transport capacity for 
independent communication sessions for a number of separate communication devices. 

A network communication device can treat all data units equally, that is, all data 
units can have the same priority when traveling over a network. Alternatively, different 
data units can have various levels of the quality of service (QoS). This concept has been 
25 applied to ATM networks (and to other network formats to some extent). The measures 
of QoS include a cell loss rate, a cell transfer delay, bandwidth, and other. The cell loss 
rate reflects the number of cells that are lost, for example, when more cells arrive at a 
switch than can be accommodated in the switch's buffer. The cell transfer delay reflects 
the amount of time a cell spends at a switch (or other storage and/or transfer device) 
before being re-transmitted. For example, if a cell sits in a buffer for a long period of 
time while other (e.g., higher QoS level) cells are transmitted, the cell transfer delay of 
this cell is the amount of time it spends in the buffer. Other measures of QoS may 
include a cell delay variation (i.e., the amount of variation in cell delay) or a maximum 
cell transfer delay (rather than an average cell transfer delay). 

Furthermore, different types of information require different transport rates of 
data. For example, real-time video transmission requires a high constant bit rate or a 
high variable bit rate to maintain synchronism, but packet data communications, in 
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5 general, do not require a constant or variable bit rate. Similarly, voice communication 
(which usually produces bursty data traffic) requires real-time transmission, but can 
tolerate some cell loss without having a detrimental impact. On the other hand, a loss of 
a small number of cells in file transfer, such as e-mail, requires re-transmission of the 
entire file. Therefore, a network communication device also needs to optimally assign 

1 0 buffers associated with individual connections to take into account the different types of 
information. Furthermore, a network communication device needs to decide whether a 
new connection can be opened, and the device needs to allocate (re-assign) optimally 
buffers when such a connection is opened. 

Therefore, there is a need for a network communication device and method that 

1 5 can efficiently allocate buffers for data transmission. 
Summary 

The present invention is a novel network communication device for directing 
network traffic and a novel method for allocating buffer units in a network 
communication device. The novel device or method allocate buffer units based on port 

20 utilization and quality of service goals to achieve fair buffer usage. 

In one aspect, a network communication device for directing data units over a 
communication network includes at least one input and/or output port arranged to receive 
and transmit data units, a plurality of buffer units divided into several sub-pools, and a 
buffer allocator for allocating buffer units between the sub-pools. The buffer allocator is 

25 arranged to determine a priority value for each sub-pool based on quality of service 

parameter for each connection established at at least one input port. The buffer allocator 
is also arranged to determine a utilization value of the input port, and arranged to allocate 
buffer units for each sub-pool based on the priority value and based on the utilization 
value, wherein a minimal number of connections established at a most utilized port will 

30 suffer loss of data units while receiving the data units. 

In another aspect, a computer-readable medium includes a representation of an 
algorithm used in a network communication device constructed for directing data units 
over a communication network. The network communication device includes a plurality 
of buffer units divided into sub-pools, and at least one input and/or output port connected 

35 to the communication network and arranged to receive and transmit data units. The 
algorithm for allocating buffer units between the sub-pools includes the steps of: 
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determining a priority value for each sub-pool based on a quality of service parameter for 
each connection established at at least one input port; 

determining a utilization value of the input port; and 

allocating buffer units for each sub-pool based on the priority value and based on 
5 the utilization value, wherein a minimal number of connections established at a most 
utilized port will suffer loss of data units while receiving the data units. 

Another aspect is a method for dynamically managing buffer units assigned to 
sub-pools of a network communication. The network communication includes at least 
one input and/or output port connected to a communication network and arranged to 
1 0 receive and transmit data units. The network communication device also includes a 
plurality of buffer units divided into several sub-pools for buffering the data units. The 
method includes specifying a priority value for each sub-pool based on at least one 
quality of service parameter for transmitting the data units from the at least one port; 
determining a utilization value of at least one input port; and allocating buffer units for 
15 each of the sub-pools based on the priority value and based on the utilization value, 

wherein a minimal number of the data units will be lost during reception or transmission 
of the data units at a most utilized port of the network communication device. 

Preferred embodiments of the above aspects include one or more of the following 
features: 

20 The buffer allocator is arranged to determine the priority value of the sub-pool 

based on all connections having the same quality of service parameter and being 
established at the port The buffer allocator is further arranged to assign the allocated 
buffer units to each of the sub-pools for use by the connections. 

The network communication device is further arranged to establish a new 

25 connection using the buffer units assigned to one of the sub-pools. The quality of service 
parameter relates to a type of bit rate handled by the connection. 

The utilization value is calculated as a port line speed minus an aggregate peak 
cell rate for an under-subscribed port having the port line speed larger than the aggregate 
peak cell rate. The utilization value is calculated as an aggregate steady state cell rate 

3 0 minus a port line speed for a fully-subscribed port having an aggregate steady state cell 
rale smaller than its port line speed and its port line speed smaller than the aggregate 
peak cell rate. The utilization value is calculated as an inverse of (an aggregate steady 
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state cell rate minus a port line speed) for a fully-subscribed port having the aggregate 
steady state cell rate larger than its port line speed. 

The network communication device may be a circuit switch, a bridge, or a router 
using a connection oriented protocol, or may be another similar device arranged to direct 
5 data units transferred from an origination device to a destination device over a 
communication network. 

The network communication device is further arranged to establish a new 
connection after the buffer allocator determines the quality of service parameter for the 
new connection, determines the number of the buffer units required for the new 
10 connection, and borrows the number of the buffer units from other sub-pools using a 

precedence order of the sub-pools. The borrowing of the number of the buffer units from 
other sub-pools includes establishing a precedence order of the sub-pools. 

The precedence order includes: 
Initially: 

15 1. Borrow the available buffer units of its own pool, Le.» buffer assigned to a sub-pool : 
but not allocated to an existing connection. 
2. Borrow all available assigned buffer units from disabled ports. 
For each US port, borrow buffer units from sub-pools in the following order: 

1 . Borrow buffer units available from all sub-pools with lower priority of all 
20 participating ports. 

2. Borrow buffer units assigned to UBR sub-pools from OS ports. 

3. Borrow buffer units assigned to UBR sub-pools from FS ports. 

4. Borrow buffer units assigned to UBR sub-pools from US ports with a lower metric 
value. 

25 5 . Borrow buffer units assigned to ABR sub-pools from OS ports. 

6. Borrow buffer units assigned id sub-pools having lower priorities from the same port 
For each PS port, borrow buffer units from sub-pools in the following order: 
1. Borrow buffer units available from all sub-pools with lower priority of all 
participating ports. 

30 2. Borrow buffer units assigned to UBR sub-pools of OS ports. 

3. Borrow buffer units assigned to UBR sub-pools of other FS ports with a lower metric 
value. 

4. Borrow buffer units assigned to sub-pools of any lower priority of the same port 

RECTIFIED SHEET (RULE 91) 
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For each OS port, borrow buffer units from sub-pools in the following order: 

1 . Borrow buffer units available from sub-pools from other priorities of the same port. 

Brief Description of the Drawings 

Fig. 1 shows diagrammatically a computer network. 

5 Fig. 2 shows diagrammatically a network switch used in the computer network of 

Fig.l. 

Fig. 3 shows a block diagram of a network interface module (ANIM). 
Figs 4 and 4A are high level flow diagrams of an adaptive buffer management 
algorithm. 

10 Description of Preferred Embodiments 

Fig, 1 shows a communication network that includes an ATM network 10, 

private networks 20, 40, 60, and a public network 55. ATM network 10 includes 
network switches 12, 14, and 16. ATM switch 12 connects ATM network 10 to private 
network 20, which includes a Token Ring network 26 and an Ethernet network 32. 

15 Network 20 includes a switch 22 connected to a bridge 24, a general purpose computer 
38 and a storage device 39. Bridge 24 connects Token Ring network 26 and Ethernet 
network 32 to switch 22. Both Token Ring network 26 and Ethernet network 32 are 
connected to general purpose computers (for example, computers 30, 34, and 36), 
printers 28 and other devices. ATM switch 14 connects ATM network 10 to a private 

20 network 40 by a bridge 42. Bridge 42 connects switch 14 to an Ethernet network 44 
connected, in turn, to computers 46 and 48 and a printer 49. ATM switch 12 also 
connects ATM network 10 to public network 55 via a router 50. ATM switch 16 
connects ATM network 1 0 to a private network 60 by a switch 62. Switch 62 connects a 
main frame computer 70 and a fiber-distributed data interface 64 (connected, in turn, to 

25 computers 66 and 68) to the communication network. 

The present invention can be used in any network communication device using 
any format, but will be explained in connection with an ATM switch. Fig. 2 shows 
diagrammatically ATM switch 12 (or any of the switches shown in Fig. 1), which can be 
a Cabletron product # 9 A686 with 4 network interface modules (ANIMs) and 4 ports per 

30 ANIM. ATM switch 12 includes a management block 76, a switching block 78, and two 
or four ANIMs. Depending on its configuration, each ANIM can include one, two, three 
or four ports that function as input or output ports. Specifically, the 9A686 switch may 
include two OC48 ANIM, each having 1 port communicating at the line speed of 2.4 
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Gbps. Alternatively, the 9A686 switch may include four OC12 ANIMs each having 2 
port communicating at the line speed of 622 Mbps- In another arrangement, the 9A686 
switch may include four OC3 ANIMs with three or four ports each communicating at the 
line speed of 1 55 Mbps. The present invention can operate in any of these arrangements. 
5 Referring to Fig. 3, in a currently preferred embodiment, ANIM 80 includes a 

converter 82 connected via a TDM bus 84 to a switching engine 86, an SRAM memory 
88, a converter 90, and input and output ports 92, 94, 96 and 98. Input and output ports 
92, 94, 96 and 98 are arrange to transmit data or receive data and provide them to 
converter 90. Converter 90 is a SONET to UTOPIA converter that converts SONET 

10 level signals, received over connections 93, 95, 97 and 99, to UTOPIA level signals. 

Converter 90 provides UTOPIA level signal to a converter 82. Converter 82 is a queuing 
and scheduling ASIC interface constructed for communication with switching engine 86. 
SRAM 88 stores data in 16 K buffer units (buffer cells), each buffer unit having 424 bits. 
SRAM 88 includes 16 buffer sub-pools, wherein four sub-pools are associated with each 

15 of the input and output ports 92, 94, 96 and 98. In another arrangement with two input 
and/or output ports, for example, SRAM 88 may be divided into 8 buffer sub-pools with 
four sub-pools per port. 

ATM switch 12 is preferably an output buffered device, but in general it may be 
an input buffered device or a combined input-output buffered device. Based on the 

20 incoming ATM eel! itself, ATM switch 12 decides if the cell is buffered or dropped. 
This decision is performed at the line speed. The decision occurs sometime after the 
start of the header and before the last bit of the data unit is received to allow re-use of the 
current buffer for the next ATM cell. To perform this process at the line speed, the 
simplest way is to forward each admitted ATM cell to an output buffer. 

25 ANIM 80 may receive ATM cells over any one of ports 92, 94, 96 and 98 and 

transmit the ceils out of any of ports 92, 94, 96 and 98. The selection of the input port 
and the output port depends on the ultimate destination of the ATM cell, the required 
bandwidth, and the type of information carried by the cell. The buffers permit ANIM 80 
to schedule the transmission and reconcile varying rates of receiving and transmitting 

30 ATM cells. For example, if ANIM 80 receives a number of cells on ports 92, 94 and 96 
and all of them are routed for transmission over the same output port 98, output port 98 
may not be able to transmit them as quickly as they are received. Accordingly, these 
ATM .cells (or data units, in general) are buffered in SRAM 88. 
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5 The ATM switch includes a buffer allocator using an algorithm described below 

and in Appendices A and B. The algorithm is executed on the Intel I960 processor that 
resides in management block 76 (Fig. 2). In general, the buffer allocator allocates 
available buffer units among the individual sub-pools according to the quality of service 
and fairness criteria. The fairness criteria ensure that a minimal number of data sets, 

1 0 having the lowest priority and using the most over-utilized port, will suffer data unit loss. 
We apply this concept to ATM. 

The specification for ATM transport defines several traffic or service categories 
supported by the ATM layer of a network. The types of service include a constant bit rate 
(CBR) service, a variable bit rate (VBR) service, an available bit rate service (ABR), and 

15 an unidentified bit rate service (UBR), For each port, we assign one sub-pool for one 
type of service (i.e., priority). u 

The CBR service provides a constant, guaranteed bandwidth over an assigned 
virtual connection. Thus, the buffer allocator needs to allocate a sufficient amount of 
buffer units for each CBR connection. The VBR service guarantees some maximum 

20 number of transmit opportunities that may be used to transmit cells over an existing 
virtual connection, for example, for bursty traffic. Over time, the actual rate or 
bandwidth may vary from almost zero (i.e., little or no use of the opportunities to send) 
up to a maximum number, called a peak cell rate (PCR), that is allocated for the 
connection. After satisfying the CBR demand, the buffer allocator allocates dynamically 

25 buffer units for each VBR connection. 

For the ABR service, the specification for ATM defines an allowed cell rate 
(ACR), a peak cell rate (PCR) and a minimum cell rate (MCR). The allowed cell rate is 
the bandwidth, in terms of ATM cells per second, currently usable by a particular ABR 
connection. Typically, the ACR for an ABR connection varies over time, for example, 

30 as a function of the traffic load on the ATM link. The data communication device may 
have an opportunity to transmit data units in time slots that are available because they are 
not used by the CBR or VBR services. The minimum cell rate (MCR) is the lowest 
bandwidth that the ABR connection is always guaranteed. The MCR may be zero, in 
which case the device regulating traffic need not reserve any bandwidth for the ABR 

35 connection. Notably, the scheduling device only needs to make a "best effort" to provide 
a bandwidth, for use by the ABR connection. The device can, if necessary, allocate all 
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transmit opportunities to higher priority traffic, in which case the ACR for the ABR 
circuit falls to zero- 
However, if an ABR connection has an MCR value greater than zero, then the 
scheduling device effectively must reserve some minimum number of cell transmit 
5 opportunities, for that connection, to support traffic for that connection at no less than the 
MCR rate. The buffer allocator dynamically allocates buffer units so that each ANIM 
can dynamically schedule traffic and guarantee non-zero minim um cell rates for its ABR 
connections. 

The buffer allocator uses the following three parameters that are available when a 

10 connection is established: (a) the type of service (also called priority); (b) a packing 
constant; and (c) a buffer sizing parameter. For ATM, the type of service parameter 
includes CBR, VBR, ABR or UBR, which were defined above. (For IP, the type of 
service parameter may include a connectionless or connection oriented service,) The 
packing constant parameter enables a proprietary management control to fine tune the 

1 5 bandwidth and buffo allocations. This parameter equals to one, where no management 
control is performed. The buffer sizing parameter defines the number of buffer units 
needed by each connection. (For IP, this parameter may be based on a packet size or 
other connection header data). 

For each ATM connection, a traffic descriptor carries a "setup*' message with one 

20 or more connection parameters. For each CBR connection, the traffic descriptor 

provides PGR, for each VBR connection it provides PCR, SCR, and a maximum buret 
rate (MBS). For each ABR connection, the traffic descriptor provides PCR and MCR, 
and for each UBR connection it provides PCR. For each port, the aggregate PCR is 
calculated by adding all provided PCRs for the individual connections. The aggregate 

25 SCR is a number calculated by adding all PCRs for all CBR connections, all SCRs for all 
VBR connection, and all MCRs for all ABR connections. However, when using a 
conservative approach, the algorithm can replace MCR by MCR+(PCR-MCR)/2, for all 
ABR connections, and can use PCR/2 for all UBR connections. 

The algorithm provided in Appendices A and B sets the buffer siring parameter 

30 as follows: For each CBR connection, the buffer sizing parameter is set to two buffer 

units, and for each VBR connection it is set to the maximum burst size (MBS). For each 
ABR connection, the buffer sizing parameter is set to the transient buffer exposure 
(TBE), which is a value that can be negotiated with each end user. Each end user can 
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request the number of buffers to be provided. However, due to the limited number of 
available buffer units, for a US port, the maximum number of buffer units will be set to 
32; for an FS port, the maximum number will be 16; and, for an OS port, the maximum 
number will be 8 buffer units. For each UBR connection, the buffer sizing parameter is 
set to 32 buffer units. However, to prevent data loss, the buffer allocator can allocate 
buffer units to a selected UBR connection. 

Importantly, the buffer allocator also assigns to each port one of the following 
three zones that described port utilization: under-subscribed (US), fully-subscribed (FS), 
and over-subscribed (OS). The particular zone is assigned based upon the aggregate 
peak cell rate (aggregate PGR) for all connections using that port, and the aggregate 
steady state cell rate (aggregate SCR) for all connections using the port. When the 
aggregate PCR is less than the ports line speed, the port is under-subscribed. When the 
aggregate PCR is greater than the ports line speed and the aggregate SCR is less than the 
ports line speed, the port is fully-subscribed. When the aggregate SCR is greater than the 
ports line speed, the port is over-subscribed. 

The buffer allocator gives a higher buffer retention priority to an under- 
subscribed (US) port than a fully-subscribed (FS) port. If needed, an over-subscribed 
(OS) port will loose buffer units first since such port is already loosing data units and the 
additional buffer loss (due to buffer allocation) would only marginally reduce the port 
performance. That is, the resulting data loss will be accepted as unavoidable for OS 
ports. On the other hand, for US ports, ANIM 80 does not drop data units even if the 
connection has a small number of buffers allocated since the US port do not exhaust 
their buffer allotment faster than they are be filled due to their low line speeds. To 
minimize the number of connections suffering data loss, FS ports are allocated any 
residual buffers, beyond its minimum allotment. 

Furthermore, the buffer allocator assigns for each port a metric for comparing the 
ports within the same zone (i.e., subscription status). For a US port, the metric value 
equals to the ports line speed minus the aggregate PCR. For a US port, the metric value 
equals to the line speed minus the aggregate SCR. For an OS port, the metric value 
equals to 1 /(aggregate SCR - the line speed). Among ports with an equal subscription 
status, the port with a higher metric value will 'get a higher priority for buffer allocation. 
The aggregate PCR also specifies the bandwidth, which is the inverse of a minimum 
inter-arrival time of data units. 
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The buffer allocator assembles buffer unit requirements for all connections that 
require buffer units, including candidate connections. If the buffer requirement value is 
less than the number of available buffer units in all buffer sub-pools, the candidate 
connections are admitted and the buffer allocator re-assigns the size of the individual 
buffer sub-pools based on the requirements of the admitted connection. This adjustment 
usually reduces the size of several buffer sub-pools and increase the size of at least one 
buffer sub-pool. The buffer allocator uses precedence ordering, provided below, to 
achieve the fairness criteria. The fairness criteria control a data unit loss suffered by a 
minimal number of connections with the lowest priority of the most over-utilized port. 

The buffer allocator establishes a precedence list that reflects the type of service 
(i.e., the priority), an operational status, and a metric value. When a sub-pool needs 
additional buffers to. establish a connection, the buffer allocator "borrows" buffer units 
from other sub-pools with lower precedence ordering, as explained in connection with 
Figs. 4 and 4A. The new connection is established if all available buffer units can 
maintain the existing connections according to the provided rules. 

Referring to Fig. 4, initially a startup algorithm creates four buffer sub-pools 
assigned for each port; that is, one sub-pool for each type of service (i.e., priority). The 
buffer allocator can statically allocate the buffer units for each sub-pool or can allocate 
buffer units by performing a buffer allocation algorithm 110. Buffer allocation algorithm 
1 10 may be performed when opening a new connection or, in general, at any time during 
the operation when there is an unexpectedly high cell loss. In a currently preferred 
embodiment, for each port, the CBR sub-pool has 512 buffer units assigned, the VBR 
sub-pool has 512 buffer units assigned, the ABR sub-pool has 1024 buffer units 
assigned, and the UBR sub-pool has 2048 buffer units assigned. 

Prior to allocating buffers, connection admission control (CAC) decides if a new 
connection can be accepted based on the attributes of both the requested connection and 
the existing connection (step 1 12). If adaptive buffering is not desired, for example, 
when starting up the device, buffers are allocated manually (114). When adaptive 
buffering is performed, in step 1 16, for each port, the buffer allocator determines the 
zone (i.e., the port utilization) and the metric value. As described above, the z;one and 
the metric value for each port are calculated based on the port line speed, the aggregate 
PCR, and the aggregate SCR for all connections using that port. 
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In step 1 1 8, the buffer allocator scans over the ports and the connections to build 
a glean list of buffer sub-pools in the precedence based on which it can borrow available 
buffers. As described above, CBR sub-pools get a higher precedence than the VBR sub- 
pools, which get a higher precedence than the ABR sub-pools and UBR sub-pools. The 
buffer allocator orders the ports by their zone putting the OS ports at the bottom, then the 
US ports and the FS at the top. Within each zone, the buffer allocator orders the ports 
based on their metric value by putting the port with the lowest metric value at the lowest 
position on the list. Based on the glean list, buffer allocator allocates buffer units in the 
order of precedence (steps 120 through 136). The order of precedence is based in the 
type of service (i.e., priority) as follows: 
Initially: 

1 . Borrow the available buffer units of its own pool, i.e., buffer assigned to a sub-pool 
but not allocated to an existing connection. 

2. Borrow all available assigned buffer units from disabled ports. 

For each US port, borrow buffer units from sub-pools in the following order: 

1 . Borrow buffer units available from all sub-pools with lower priority of all 
participating ports. 

2. Borrow buffer units assigned to UBR sub-pools from OS ports. 

3. Borrow buffer units assigned to UBR sub-pools from FS ports. 

4. Borrow buffer units assigned to UBR sub-pools from US ports with a lower metric 
value. 

5. Borrow buffer units assigned to ABR sub-pools from OS ports. 

6. Borrow buffer units assigned to sub-pools having lower priorities from the same port. 

For each FS port, borrow buffer units from sub-pools in the following order: 

1 . Borrow buffer units available from all sub-pools with lower priority of all 
participating ports. 

2. Borrow buffer units assigned to UBR sub-pools of OS ports. 

3. Borrow buffer units assigned to UBR sub-pools of other FS ports with a lower metric 
value. 

4. Borrow buffer units assigned to sub-pools of any lower priority of the same port. 
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5 For each OS port, borrow buffer units from sub-pools in the following order: 

1 . Borrow buffer units available from sub-pools from other priorities of the same port. 

Fig. 4 A shows a flow diagram using the above procedure. In step 122, the buffer 
allocator borrows available buffer units (i.e., assigned but not allocated) and then 
borrows buffer units from disabled ports. If additional buffer units are needed, the buffer 

10 allocator scans each port and identifies US ports (step 124), FS ports (step 128), and OS 
ports (step 132). First, to provide buffers for FS or US ports, the buffer allocator borrows 
from any sub-pool of an OS port, which has a lower priority (i.e. type of service). To 
provide buffers for an OS port, the buffer allocator borrows from any sub-pool of an OS 
port with a lowed metric value (step 134). At any stage, when the buffer demand is 

15 satisfied (i.e., the number of borrowed buffer units equals the number of buffer units 
needed to establish a new connection), the buffer allocator returns to step 136. 

In steps 126 and 130, if additional buffer units are needed, the buffer allocator 
identifies FS or US ports and borrows buffer units assigned to UBR sub-pools from OS 
ports starting with an OS port having the lowest priority. Additionally, the buffer 

20 allocator can borrow buffer cells assigned to UBR connections of FS ports, starting with 
an FS port having a lower priority, and provide them to another FS port. Next, if an US 
- port needs buffers, the buffer allocator borrows ABR buffer cells from OS ports. If an 
US port needs further buffers, the buffer allocator borrows ABR buffer cells from FS 
ports, starting with an FS port having a lower priority. Finally, an FS port can borrow 

25 buffer units from any FS port with a lower priority, and any US port can borrow buffer 
units from any US port with a lower priority . That is, the algorithm follows the order of 
precedence provided above. As the buffer allocator borrows assigned buffer units from 
any sub-pool in the order of precedence, the remaining buffer units may be smaller than 
the number of buffer units allocated to existing connections in that sub-pool. After 

30 re-assignment of buffer units to a newly admitted connection, the existing connections, 
of the sub-pool with insufficient buffer units, will loose data units. However, the order 
of precedence ensures that only connections having the lowest priority (i.e., type of 
service) and using the most over-utilized port, will suffer data unit loss. 

When the buffer demand is not satisfied, the buffer allocator rejects the 

35 considered new connection; 
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5 Example 1 

The following is an example of buffer assignment and buffer allocation for a 
single port when establishing a new VBR connection that requires six buffer units. 
Referring to Table 1-1, initially, port n has 96 buffer units assigned to the CBR sub-pool, 
96 buffer units assigned to the VBR sub-pool, 128 buffer units assigned to the ABR sub- 

10 pool, and 256 buffer units assigned to the UBR sub-pool Table 1-2 shows the allocated 
buffer units (i.e., buffer units used by the existing connections) out of the assigned buffer 
units, shown in Table 1-1 . Specifically, all CBR connections use 16 buffer units from the 
CBR sub-pool, all VBR connections use 12 buffer units, all ABR connections use 100 
buffer units, and all UBR connections use 136 buffer units. Prior to admitting the new 

15 VBR connection at port n, the VBR sub-pool has 96 assigned buffer units, but uses for 
all its connections only 12 buffer units, thereby having 84 buffer units available. Thus, 
in step 122, buffer allocator allocates six buffer units to the new connection out of the 84 
available buffer units in the VBR sub-pool. As shown in Tables 1-3, no new assignment 
is required when establishing the VBR connection . Table 1-4 shows that the VBR sub- 

20 pool now has 1 8 allocated buffer units. 

Prior to admitting a new connection After admitting a new connection 
Assignment : Assignment : 



Port n 




Port n 


Type of 
Service 


Buffers 




Type of 
Service 


Buffers 


CBR 


96 




CBR 


96 


VBR 


96 




VBR 


96 


ABR 


128 




ABR 


128 


UBR 


256 




UBR 


256 




Table I- 1 




Table 1-3 



JNSOOCID: <WO 0052955A1_I_> 



WO 00/52955 



PCT/US00/04965 



-17- 



Allocation: Allocation: 



Portn 




Portn 


Type of 
Service 


Buffers 




Type of 
Service 


Buffers 


CBR 


16 




CBR 


16 


VBR 


12 




VBR 


18 


ABR 


100 




ABR 


100 


UBR 


136 




UBR 


136 




Table 1-2 




fable 1-4 



Example 2 

The following is an example of buffer assignment and buffer allocation when 
establishing at port 1 a new CBR connection requiring 44 buffer units. Tables II- 1 
through H-8 show existing buffer assignments and allocations for the individual sub- 
pools of ports 0, 1, 2 and 3. As shown in Tables II- 1, the CBR sub-pool has assigned 96 
buffer units, the VBR sub-pool has assigned 96 buffer units, the ABR sub-pool has 
assigned 128 buffer units, and the UBR sub-pool has assigned 120 buffer units. 
Referring to Tables II-2, out of the assigned buffer units, 92 buffer units are allocated to 
existing CBR connections, 92 buffer units are allocated to existing VBR connections, 
124 buffer units are allocated to existing ABR connections, and 1 14 buffer units are 
allocated to existing UBR connections. 
Prior to admitting a new CBR connection: 
Assignment: 



PortO 




Port 1 i 




Port 2 




Port 3 
(Disabled) 


Type of 
Service 


Buffers 




Type of 
Service 


Buffers 




Type of 
Service 


Buffers 




Type of 
Service 


Buffers 


CBR 


96 




CBR 


96 




CBR 


92 




CBR 


4 


VBR 


96 




VBR 


96 




VBR 


100 




VBR 


0 


ABR 


128 




ABR 


112 




ABR 


148 




ABR 


0 


UBR 


120 




UBR 


136 




UBR 


100 




UBR 


0 


Table II- 1 




Table II-3 




Table II-5 




Table II-7 
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5 Allocation: 



PortO 




Port 1 




Port 2 




Port 3 
(Disabled) 


Type of 
Service 


Buffers 




Type of 
Service 


Buffers 




Type of 
Service 


Buffers 




Type of 
Service 


Buffers 


CBR 


92 




CBR 


94 




CBR 


86 




CBR 


0 


VBR 


92 




VBR 


96 




VBR 


94 




VBR 


0 


ABR 


124 




ABR 


112 




ABR 


142 




ABR 


0 


UBR 


114 




UBR 


136 




UBR 


96 




UBR 


0 


Table II-2 




Table II-4 




Table II-6 




Table 


II-8 i 



Prior to admitting the new CBR connection to port one the buffer allocator creates a 
glean list shown as Table III. 
Glean list: 



Port 


Priority 


Amount 


Total buffers 


1 


CBR 


2 


0 


3 


CBR 


4 


6 


1 


UBR 


0 


6 


0 


UBR 


6 


12 


2 


UBR 


4 


16 


1 


ABR 


0 


16 


0 


ABR 


4 


20 


2 


ABR 


6 


26 


1 


VBR 


0 


26 


0 


VBR 


4 


30 


2 


CBR 


6 


36 


1 


CBR 


0 


36 


0 


CBR 


4 


40 


2 


CBR 


4 


44 



Table III 
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5 In step 116, buffer allocator determined that, for example, all ports 0, 1 , and 2 are 

all under- subscribed us ports having the following asymmetric order: [Port 1 , Port 0, and 
Port 2]. In step 122, the buffer allocator borrows two available buffers in the CBR sub- 
pool of port 1 (since the CBR sub-pool has 96 assigned buffers, but only 94 buffers 
allocated to existing CBR connections). Next, in step 122, buffer allocator borrows four 

1 0 buffer units from port 3, which is disabled. Thus, the total available buffer units is now 6 
(as shown in Table III). Since all ports are under subscribed, from step 124 buffer 
allocator proceeds to step 126. First, buffer allocator will borrow from sub-pools of all 
sub-pools with lower priority (type of service) assigned to all participating ports. 
According to the metric order, first buffer allocator will examine the UBR sub-pool of 

15 port 1 and determine that all assigned 136 buffer units were allocated to existing UBR 
connections leaving no available buffer units to borrow. Thus, the total available buffer 
units remain 6 at this point. Next, according to the metric order, buffer allocator goes to 
the UBR sub-pool of port (Table II- 1). Here, out of the 120 assigned buffer units, 1 14 
were allocated leaving six buffer units to borrow. Thus, the total number of available 

20 buffer has increased to 12 (Table III). Next, the buffer allocator examines the ABR sub- 
pools of all three ports according to the metric order. The ABR sub-pool of port 1 has 
1 12 buffer units assigned and 1 12 buffer units allocated leaving no available buffer units. 
The ABR sub-pool of port 0 has 128 buffer units assigned but only 124 buffer units 
allocated leaving four available buffer units to borrow... After examining the VBR sub- 

25 pool of port 2, which has 6 available buffers, the total amount of available buffers is 36. 
Next, buffer allocator looks at the CBR sub-pools of all ports according to their metric 
values. In the CBR sub-pool of port 1, all buffer units are allocated to existing CBR 
connections. (Note: The two available buffer units were entered into the glean list 
initially) In the CBR sub-pool of port 0, four buffer units are available. In the CBR sub- 

30 pool of port 2, 92 buffer units are assigned but only 86 buffer units are allocated to 

existing CBR connections. Thus, six buffer units are available to borrow. However, the 
new CBR connection requires only four more buffer units to reach the required number 
of 44 buffer units to admit the connection. 

After admitting a new CBR connection having 44 buffers allocated: 

35 Assignment : 
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PortO 




Portl 




Port 2 




Port 3 
(Disabled) 


Type of 
Service 


Buffers 




Type of 
Service 


Buiter 

s 




Type of 
Service 


Buffers 




Type of 
Service 


Buffers 


CBR 


96 




CBR 


138 




CBR 


88 




CBR 


0 


VBR 


92 




VBR 


96 




VBR 


94 




VBR 


0 


ABR 


124 




ABR 


112 




ABR 


142 




ABR 


0 


UBR 


114 




UBR 


136 




UBR 


96 




UBR 


0 


Table IV- 1 




Table IV-3 




Table IV-5 




Table IV-7 



Allocation: 



PortO 




Port 1 




Port 2 




Port 3 
(Disabled) 


Type of 
Service 


Buffers 




Type of 
Service 


Buffers 




Type of 
Service 


Buffers 




Type of 
Service 


Buffers 


CBR 


92 




CBR 


138 




CBR 


86 




CBR 


0 


VBR 


92 




VBR 


96 




VBR 


94 




VBR 


0 


ABR 


124 




ABR 


112 




ABR 


142 




ABR 


0 


UBR 


114 




UBR 


136 




UBR 


96 




UBR 


0 


Table IV-2 




Table IV-4 




Table IV-6 




Table 


IV-8 



Tables IV- 1 through IV-8 show the new assignments and allocations of the buffer 
units. After admitting the new connections, 138 buffer units are assigned to the CBR 
10 sub-pool of port 1 and all 138 buffer units are allocated to the existing CBR connections. 

The buffer allocator may also execute another allocation algorithm that is an 
obvious modification of allocation algorithm 1 10. Such modified algorithm is also 
within the true scope of the inventions described above. Additional embodiments are 
within the following claims: 



3NSDOCID: <WO_0052955A1_I_> 



WO 00/52955 



PCT/US00/04965 



-21- 

5 CLAIMS 

1 . A method for dynamically managing buffer units assigned to sub-pools of a 
network communication device comprising: 

providing a network communication device including at least one input and 
output port connected to a communication network and arranged to receive and transmit 
data units, said network communication device including a plurality of buffer units 
divided into several sub-pools for buffering said data units; 

specifying a priority value for each said sub-pool based on at least one quality of 
service parameter for transmitting said data units from said at least one port; 
determining a utilization value of said at least one port; and 
allocating buffer units for each of said sub-pools based on said priority value and 
based on said utilization value, wherein a minimal number of said data units is lost 
during reception or transmission of said data units at a most utilized port of said network 
communication device. 

2. The method of claim 1 wherein said priority value of said sub-pool is 
determined based on all connections having the same quality of service parameter and 
being established at said port. 

25 3. The method of claim 2 further comprising assigning said allocated buffer units 

to each of said sub-pools for use by said connections. 

4. The method of claim 3 further comprising establishing a new connection using 
said buffer units assigned to one of said sub-pools. 

30 

5. The method of claim 2, 3 or 4 wherein said quality of service parameter 
relates to a type of bit rate handled by said. connection. 

6. The method of claim 2, 3 or 4 wherein said quality of service parameter 
35 includes one of the following types of service: a constant bit rate (CBR) service, a 

variable bit rate (VBR) service, an available bit rate service (ABR), and an unidentified 
bit rate service (UBR). 
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7. The method of claim 2, 3 or 4 wherein said utilization value is calculated as a 
port line speed minus an aggregate peak cell rate for an under-subscribed port having the 
port line speed larger than the aggregate peak cell rate. 

8. The method of claim 2, 3 or 4 wherein said utilization value is calculated as an 
aggregate steady state cell rate minus a ports line speed for a fully-subscribed port 
having an aggregate steady state cell rate smaller than its port line speed and its port line 
speed smaller than the aggregate peak cell rate. 

9. The method of claim 2, 3 or 4 wherein said utilization value is calculated as an 
inverse of (an aggregate steady state cell rate minus a ports line speed) for a fully- 
subscribed port having the aggregate steady state cell rate larger than its port line speed. 

10. The method of claim 4 wherein said establishing said new connection 
includes: 

determining said quality of service parameter for said new connection; 
determining the number of said buffer units required for said new connection; 

and 

borrowing said number of said buffer units from other sub-pools. 

1 1 . The method of claim 1 0 wherein said borrowing said number of said buffer 
units from other sub-pools includes establishing a precedence order of said sub-pools. 

12. The method of claim 1 1 wherein said establishing said precedence order 
includes: 

(a) initially: 

al . borrow the available buffer units of its own pool, i.e., buffer assigned 
to a sub-pool but not allocated to an existing connection; 

a2. borrow all available assigned buffer units from disabled ports; 

(b) for each US port, borrow buffer units from sub-pools in the following order: 

bl . borrow buffer units available from all sub-pools with lower priority of 
all participating ports; 

b2. borrow buffer units assigned to UBR sub-pools from OS ports; 
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5 b3. borrow buffer units assigned to UBR sub-pools from FS ports; 

b4. borrow buffer units assigned to UBR sub-pools from US ports with a 
lower metric value; 

b5. borrow buffer units assigned to ABR sub-pools from OS ports; 
b6. borrow buffer units assigned to sub-pools having lower priorities from 
10 the same port; 

(c) for each FS port, borrow buffer units from sub-pools in the following order: 

cl. borrow buffer units available from all sub-pools with lower priority of 
all participating ports; 

c2. borrow buffer units assigned to UBR sub-pools of OS ports; 
15 c3. borrow buffer units assigned to UBR sub-pools of other FS ports with 

a lower metric value; 

c4. borrow buffer units assigned to sub-pools of any lower priority of the 
same port; and 

(d) for each OS port, borrow buffer units available from sub-pools from other 
20 priorities of the same port. 

13. A network communication device for directing data units over a 
communication network, including: 

at least one input and output port connected to the communication network and 
25 arranged to receive and transmit data units; 

a plurality of buffer units divided into several sub-pools; and 
a buffer allocator for allocating buffer units between said sub-pools, said buffer 
allocator being arranged to determine a priority value for each sub-pool based on a 
quality of service parameter for each connection established at said at least one port; said 
30 buffer allocator being arranged to determine a utilization value of said at least one port, 
and said buffer allocator being also arranged to allocate buffer units for each sub-pool 
based on said priority value and based on said utilization value, wherein a minimal 
number of connections established at a most utilized port will suffer loss of data units 
while receiving said data units.. 

35 
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14. The network communication device of claim 13 wherein said buffer allocator 
is arranged to determine said priority value of said sub-pool based on all connections 
having the same quality of service parameter and being established at said port. 

15. The network communication device of claim 14 wherein said buffer allocator 
is further arranged to assign said allocated buffer units to each of said sub-pools for use 
by said connections. 

16. The network communication device of claim 15 further arranged to establish 
a new connection using said buffer units assigned to one of said sub-pools. 

1 7. The network communication device of claim 14, 15 or 1 6 wherein said 
quality of service parameter relates to a type of bit rate handled by said connection. 

18. The network communication device of claim 14, 15 or 16 wherein said 
utilization value is calculated as a port line speed minus an aggregate peak cell rate for 
an under-subscribed port having the port line speed larger than the aggregate peak cell 
rate. 

19. The network communication device of claim 14, 15 or 16 wherein said 
utilization value is calculated as an aggregate steady state cell rate minus a ports line 
speed for a fully-subscribed port having an aggregate steady state cell rate smaller than 
its port line speed and its port line speed smaller than the aggregate peak cell rate. 

20. The network communication device of claim 14, 15 or 16 wherein said 
utilization value is calculated as an inverse of (an aggregate steady state cell rate minus a 
ports line speed) for a fully-subscribed port having the aggregate steady state cell rate 
larger than its port line speed. 

21 . The network communication device of claim 1 6 further arranged to establish 
a new connection after said buffer allocator determines said quality of service parameter 
for said new connection, determines the number of said buffer units required for said 
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5 new connection, and borrows said number of said buffer units from other sub-pools 
using a precedence order of said sub-pools. 

22. A computer-readable medium for use in a network communication device 
constructed for directing data units over a communication network, said network 
10 communication device including a plurality of buffer units divided into sub-pools, and at 
least one input and output port connected to a communication network and arranged to 
receive and transmit data units, said computer-readable medium including a 
representation of an algorithm for allocating buffer units between said sub-pools by the 
steps of: * 
1 5 determining a priority value for each sub-pool based on a quality of service 

parameter for each connection established at said at least one port; 
determining a utilization value of said at least one port; and 
allocating buffer units for each sub-pool based on said priority value and based 
on said utilization value, wherein a minimal number of connections established at a most 
20 utilized port will suffer loss of data units while receiving said data units. 
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